Skip to content

docs: refresh validation benchmark with fair methodology - #21

Merged
mhweiner merged 4 commits into
mainfrom
docs/fresh-benchmark-results
Aug 2, 2026
Merged

docs: refresh validation benchmark with fair methodology#21
mhweiner merged 4 commits into
mainfrom
docs/fresh-benchmark-results

Conversation

@logfox-agent

Copy link
Copy Markdown
Contributor

Summary

  • Re-ran validation benchmark against pinned zod 4.4.3, joi 18.2.3, and yup 1.7.1
  • Fixed benchmark fairness: fixture correctness gate, abortEarly: false for Joi/Yup invalid passes, Zod safeParse
  • Updated README performance table to show total time for 200k runs (~97 ms runtyp vs 901 ms joi, 1,389 ms zod, 15,837 ms yup)
  • Added docs/benchmark.md with full methodology, per-run breakdown, and reproduce steps

Test plan

  • npm run validate
  • npm run benchmark (fixture check passes; numbers match README/docs)
  • Local Bugbot review (lockfile pinning fixed)

Re-run against pinned zod 4.4.3, joi 18.2.3, and yup 1.7.1 with fixture
checks, abortEarly: false for full invalid scans, and clearer docs.
Include runtyp and competitor version numbers in README, benchmark
report, and script output.
Replace the simple user fixture with an event-ingestion payload (nested
objects, enums, UUIDs, URL arrays, string map) and remove stale
conf/Conf.d.ts gitignore entry.
@mhweiner
mhweiner merged commit bf8fd25 into main Aug 2, 2026
4 checks passed
@mhweiner
mhweiner deleted the docs/fresh-benchmark-results branch August 2, 2026 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants